Rigorous decimation-based construction of ground pure states 
for spin glass models on random lattices. 



S. Cocco 1 , 0. Dubois 2 , J. Mandler 2 and R. Monasson 3:4 
1 CNRS-Laboratoire de Dynamique des Fluides Complexes, 3 rue de I'Universite, 67000 Strasbourg, France; 
, 2 CNRS-Laboratoire d'Informatique de Paris 6, 4 place Jussieu, 75005 Paris, France; 

■ 3 CNRS-Laboratoire de Physique Theorique de PENS, 24 rue Lhomond, 75005 Paris, France; 

4 CNRS-Laboratoire de Physique Theorique, 3 rue de I'Universite, 67000 Strasbourg, France. 
C\l '■ (February 6, 2008) 



A constructive scheme for determining pure states (clusters) at very low temperature in the 
3-spins glass model on a random lattice is provided, in full agreement with Parisi's one step replica 
symmetry breaking (RSB) scheme. Proof is based on the analysis of an exact decimation procedure. 
When the number c of couplings per spin is smaller than some critical value Cd, all spins are 
eliminated at the end of decimation (RS phase). In the range Cd < c < c s , a reduced Hamiltonian 
is left; each ground state (GS) of the latter is a "seed" from which a cluster of GS of the original 
' Hamiltonian can be reconstructed. Above c s , GS are frustrated with an energy per spin larger 

than — c. The number of GS in each cluster, the number of clusters, the distances between GS are 
calculated and correspond to RSB predictions. 
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Parisi's replica symmetry breaking (RSB) theory and its physical interpretation have turned out to be very fruitful 
for the investigation of disordered systems over the last twenty years [0 . Unfortunately, the mathematical basis for 
RSB is rather weak. Rigorous studies confirming RSB predictions have been limited to few mean-field models so far 
||. One of the most striking assumptions in RSB theory, the existence of numerous pure states, or clusters, in phase 
space on which Gibbs measure becomes concentrated at low temperature is still not fully understood even at the 
mean field level despite recent progresses || , not to speak about its applicability to finite dimensional systems. 

In this Letter, we present a rigorous study of a spin glass model which allows us to identify explicitely pure states 
for a given sample. Our analysis consists in decimating well chosen spins appearing in the original Hamiltonian H . 
£j ' When decimation stops, two cases may occur depending on the value of control parameters. If no spin is left, the 
l— ~~ ', partition function is entirely known, as well as the properties of H; this situation corresponds to the existence of a 
' single pure state and replica symmetry (RS). Otherwise, some reduced Hamiltonian H' involving a subset S' of the 
original set of spins S has to be treated. The ground states (GS) of H 1 can be interpreted as seeds for the (low 
Q\ 1 temperature) pure states of H . More precisely, all GS in a pure state of H can be reconstructed when backtracking 
the original decimation procedure from the seed of this cluster. Analysis of the statistical properties of seeds in the 
S 1 space, and of the reconstruction process provides a full characterization of the structure of GS in the S space. 
The model we consider is the so-called 3-spins Ising spin glass. M triplets of distinct integers i m < jm < k m are 
' randomly chosen in the range 1, N; plaquette m, formed by the attached spins, is associated a coupling J m equal 
, to ±1 with equal probabilities. The Hamiltonian 



X 



M 

H = — ^ Jm Si m Sj m Sk m ■ (1) 



equals — M plus twice the number of frustrated plaquettes. We shall use c to denote the number of plaquettes per 
spin, M/N. The thermodynamical properties of model (Q) were first investigated when all spins interact together i.e. 
' in the limit of large ratios c ||0]. Three phases were found. When the temperature T is larger than Td{c) ~ 0.68^/c, 
. the system is paramagnetic (RS phase) At low temperatures T < T s (c) ~ 0.65^/c ||, the system is trapped in one 
of the few existing glassy pure states. In the intermediate range T s < T < Td, there exist an exponential number of 
glassy pure states, separated by infinite barriers [Q. The onset of ergodicity breaking at Td, well above the equilibrium 
transition taking place at T s , has made Hamiltonian (^) a sensible mean field model of structural glass, and led to 
intense investigations of its out-of-equilibrium dynamical properties . 

As the ratio c of plaquettes (interactions) per spin decreases, so do the temperatures Td and T s . The ratios 
Cd — 0.818 and c s ~ 0.918 at which they respectively vanish were recently calculated in the framework of one step 
RSB theory p], with the following zero temperature picture [Q. For c < c s (respectively c > c s ), the ground state 
(GS) of Hamiltonian (0) are unfrustrated (resp. frustrated) with an energy per spin equal to (resp. larger than) 
— c. In the unfrustrated phase, the number of GS scales as 2 Ns where the zero temperature entropy simply equals 
s = 1 — c (base 2 logarithm) (Fig. 1). With high probability, two GS differ by a number of spins equal to Nd with 
d = 1/2. The spatial organization of GS in the space of configurations S (A^-dimensional hypercube) undergoes a 
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drastic change at Cd (Fig. 1), reminiscent of the ergodicity breaking taking place at Td{c). The set of GS breaks into a 
large number, 2 Ns ° , of clusters, each containing an exponential number, 2 Nsi , of GS. Two GS belonging to different 
clusters lie apart at a Hamming distance do = d = 1/2 while, inside a cluster, the distance is smaller, and equal to 
d\ = (1 — b)/2. b, the largest root of 

b=l-e- 3cb2 , (2) 

measures the size of the cluster backbone, i.e. the fraction of spins common to all GS in a cluster. The entropies of 
clusters, sq = b — 3cb 2 + 2c6 3 , and GS in a cluster, s% — s — so, have been computed within the RSB framework M. 
The corresponding curves are shown on Fig. 1. At the total entropy s is analytic in c, while the order parameter 
&, the entropies so, si undergo discontinuous (first order) jumps e.g. from b^ — to 6j ~ 0.71. 

We now sketch how the above results may found back rigorously. Full proofs will be given in an extended publication 
in a mathematical journal. The techniques used are borrowed from probability theory, and the analysis of algorithms. 
Their use was suggested from the close relationship between Hamiltonian ([!]) and the random 3-XORSAT optimization 
problem [f|||J§] ■ Let us call £-spin a spin which appears in I distinct plaquettes in (Q) . Plaquettes containing at least 
a 1-spin are never frustrated. Our decimation procedure consists in a recursive elimination of these plaquettes and 
attached 1-spins (Fig. 2), until no 1-spin is left flQfl . We define the numbers Ne(T) of £-spins after T steps of the 
decimation algorithm, i.e. once T plaquettes have been removed, and their set Af(T) — {Ne(T), £ > 0}. The variations 
of the Ngs during the (T + l) th step of the algorithm are stochastic variables due to the randomness in (|l|) and the 
choice of the 1-spin to be removed, with conditional expectations with respect to A/"(T) given by 

E[N e (T+l)-N i (T)\Af(T)]=2p i+1 (T)-2p e (T) + 5 efi -S t ,i , (3) 

where 6 denotes the Kronecker function. When a plaquette is removed, a 1-spin disappears (-<5^i term in (|^)) to 
become a 0-spin {8g o)- The plaquette contains two other spins. The number of occurrences I of each of these two 
spins is distributed with probability pe (T) = I N^{T)/2>/(M — T), and is diminished by one once the plaquette is taken 
away. For large sizes N, the densities ri£ — Ni/N of £-spins becomes self-averaging, and evolve on a long time scale 
of the order of N [0. Defining the reduced time t = T/N, the densities obey a set of coupled differential equations 
which can be deduced from (J3J) , 

" W^) +^o-^,i. (4) 

Initially, densities are Poisson distributed: n^(0) = e~ 3c (3c) /I!. Equation (^) may be solved, with the result 

ni (t) = 3cb(t) 2 (V 3cb « 2 +6(t)-l) , (5) 

where b(t) = (1 — t/c) 1 ^ 3 , while ng(t) is given by a Poisson distribution of parameter 3cb(t) 2 for l~>2. The density 
of 1-spins is showed on Fig. 3 for various initial plaquettes per spin ratios c. The algorithm stops at the time t* for 
which ni vanishes, that is, when no 1-spin is left. From eqn. (||), b(t*) coincides with b defined from eqn. (||) Jl2| . 

What does the reduced Hamiltonian H 1 look like once the decimation has stopped? For c < Cd, t* — c and no spin 
and plaquette is left. The entropy s of (unfrustrated) GS of H can be computed recursively. Each time a plaquette 
containing t>(> 1) 1-spins and these v vertices are removed (Fig. 2), the number of GS gets divided by 2' u_1 , and the 
average entropy (base 2 logarithm) of GS decreased by E[i; — l\J\f(T)] — 2p\(T). As no spin is left when the algorithm 
stops, the final value for the entropy vanishes, giving 



t* 







where the last term comes from the contribution no(0) of 0-spins. Using eqn. (^|) and t* = c, wc find back s = 1 — c. 
When Cd < c < c s , the decimation procedure stops at t* < c, and has not succeeded in eliminating all plaquettes 
and spins. The remaining fraction of plaquettes per spin, d = (c — t*)/a where a = X^>2 n ^*)> ^ s plotted as a 
function of c in Inset of Fig. 3. Each GS of H' can be seen as a 'seed' from which a cluster of GS of H in the 
original configuration space can be reconstructed. To do so, plaquettes which were eliminated during decimation are 
reintroduced, one after the other, and the spins they contain are assigned all possible values that leave the plaquettes 
unfrustrated. Combining any of these partial spin assignments with (free) 0-spins assignments, all the GS in a cluster 
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are obtained. Repeating the argument leading to the calculation of the entropy in the c < Cd case, we find that the 
average entropy s\ of GS in a cluster is precisely given by the r.h.s. of eqn. (0), and agrees with the RSB prediction. 

To complete our description of clusters, some statistical knowledge about their seeds is required. The number U' 
of unfrustrated GS of H' can be analyzed by means of the first and second moments method Jl3[ ] , giving respectively 
some upper and lower bound to the probability Pr(W > 1) of existence of unfrustrated GS, 

|P) <Pt(W>1)<E(W) . (7) 

The right inequality is a consequence of the Markov bound for positive variables, Pr (W > a) < E (W) /a with a = 1, 
while the left inequality can be established from the Cauchy-Schwarz inequality, E (W .V) 2 < E (W 2 ) .E (V 2 ), taking 
V = 1 — Syrfi. As shown below, the lower and upper bounds to the threshold c' s separating unfrustrated and frustrated 
phases obtained from eqn. (Q) coincide, which allows an exact determination of c' s . 

In the limit of a large number N' of non-decimated spins, the first moment depends only on the numbers of spins 
and plaquettes: E(W') = 2^ ( 1 ~ c ). From (Q), we conclude that U' almost surely vanishes when d > 1. On the 
contrary, the second moment is affected by the existence of contraints on the minimal number (two) of occurrences 
of spins in H'. Its computation requires a combinatorial analysis of the number of Hamiltonians H, i.e. ways of 
choosing plaquettes and couplings in (Q), having a given pair of configurations for GS. As this number depends only 
on the distance d! between the two configurations, E(W 2 ) may be expressed as a combinatorial sum involving level-2 
generalized Stirling numbers of the second kind i.e. the number of ways to partition objects (spins in plaquettes) into 
subsets (spin indices) having each at least two elements || . Very general asymptotic estimates for these have recently 
been found, which involve parameters implicitly defined by transcendental saddle-point equations |OL In the present 
case and for d < 1, our sum has just one dominant exponential term, which is precisely 4 N ( 1-c or the square of the 
first moment. The non-exponential contributions are insufficient to modify this picture. So, for c' < 1 and N' — > oo, 
the l.h.s. of (^) is asymptotically equal to unity, and GS are almost surely unfrustrated. The value c s of c giving 
c' = 1 is found from the analysis of the algorithm (Inset of Fig. 3) to be ~ 0.918. In addition, the entropy s' Q = 1 — c' 
of UGS allows to find back the RSB expression for the entropy of clusters, so — & s b- 

The self-averageness of W , i.e. of the partition function Z' ~ U'e M l T in the low temperature T — > limit, 
constrasts with the (sample-to-sample) fluctuations exhibited by U. Indeed, a direct application of inequalities (Q) 
to U only permits to derive upper (c s < 1) and lower (c s > 0.889) bounds to the threshold [0. Fluctuations ofU thus 
essentially come from fluctuations in the numbers Nq and N\ of 0- and 1-spins (whose plaquettes form the dangling 
ends of the graph on Fig. 2) removed by the decimation algorithm. This comes as no surprise since variations of Nq 
and N% induce drastic changes on the number of GS e.g. the presence of a 0-spin multiply the number of GS by two. 
Conversely, in H 1 , spins appear at least twice and are more interconnected, giving rise to weaker fluctuations for hi 1 . 

The reconstruction process allows a complete characterization of GS, in terms of an extensive number of (possibly 
overlapping) blocks made of few spins, each block being allowed to flip as a whole from a GS to another. When c < c^, 
with high probability, two randomly picked GS differ over a fraction d = 1/2 of spins, but are connected through a 
sequence of O(N) successive GS differing over O(l) spins only. For Cd < c < c s , flippable blocks are juxtaposed to 
a set of seed-dependent frozen spins. The largest Hamming distance d™ ax {> d\) between two GS associated to the 
same seed can be shown to be lower than the smallest possible distance d™ m (< do = 1/2) between any two seeds, 
thus proving the clustering property (Fig. 1). 

The above results may be extended to multi p-spins interactions with p ^ 3, with results in agreement with replica 
theory: the p > 4 case is qualitatively similar to p = 3; for p = 2, Cd = c s = 1/2 both coincide with the percolation 
threshold. Another extension regards finite temperature. For c < Cd, the decimation algorithm allows a complete 
calculation of the free energy. Whether 1-spins are set to frustrate, or unfrustrate the plaquette they belong to, the 
energy is increased, or decreased by one. The resulting free energy density equals f(T) — — Tln2 — cTlncosh(l/T) 
in agreement with the replica paramagnetic calculation The same expression for / is likely to be established for 
Cd < c < c s through an extension of the above approach. Investigation of the frustrated region, c > c s , is currently 
under way, and would ultimately permit a rigorous construction of the continuous RSB phase. Our results also sheds 
some light on the observed coincidence between the onset of RSB and the failure of a leaf removal algorithm in the 
vertex covering of random graphs Jig] . Finally, it would be interesting to see how our spin decimation approach could 
be extended to other distributions of random lattices. 
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FIG. 1. GS structure and entropies as a function of the ra- 
tio c of plaquettes per spin. The total entropy (log. number 
of unfrustrated GS per spin) is s — 1 — c for c < c 3 ~ 0.918. 
For c < Cd — 0.818, GS are uniformely scattered on the 
iV- dimensional hypercube, with a typical normalized Ham- 
ming distance d = 1/2. At Cd, the GS space discontinuously 
breaks into disjoint clusters: the Hamming distance d\ ~ 0.14 
between solutions inside a cluster is much smaller than the 
typical distance do = 1/2 between two clusters (RSB transi- 
tion). The entropy of clusters, so, and of solutions in each 
cluster, si, are such that so + Si = s. At c s , the number of 
clusters ceases to be exponentially large (so = 0). Above c s , 
GS are frustrated. 





FIG. 2. Graph representation of the 3-spins Hamiltonian. 
Vertices (spins) are joined by plaquettes (values ±1 of cou- 
plings are not shown here). A step of decimation consists 
in listing all 1-spins (gray vertices), choosing randomly one of 
them (gray vertex pointed by the arrow) , and eliminating this 
spin and its plaquette. New 1-spins may appear. Decimation 
is repeated until no 1-spin is left. 
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FIG. 3. Evolution of the density of 1-spins m (t) generated 
by the decimation procedure. For c < Cd — 0.818, ni(t) re- 
mains positive until all the plaquettes are eliminated at t* = c. 
For c > Cd the decimation procedure stops at the time t* for 
which m vanishes (black dots), and the solution of eqn. (^) 
is non physical for t > t* (dashed part of the curves). No- 
tice that t* discontinuously jumps down at c = Cd (first or- 
der transition). Inset: plaquette density c' for the reduced 
Hamiltonian H' vs. c. At c = Cd, c' discontinuously jumps to 
a positive value; the threshold c' = 1 for the disappearance of 
unfrustrated GS is reached for c s ~ 0.918. 
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